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Introduction 


Reliability  growth  prediction  and  assessment  are 
widely  used  in  development  programs  for  complex  systems.  A 
number  of  mathematical  models  have  been  developed  for  des¬ 
cribing  the  change  in  the  system  reliability  as  the  design 
matures.  Usually  the  growth  results  from  a  test,  analysis 
and  fix  program;  and  most  of  the  models  have  focused  on  re¬ 
pairable  systems.  While  these  methods  may  be  applicable  to 
ideal  development  programs  (those  with  no  human  judgment 
errors) ,  they  are  frequently  lacking  when  applied  to  real 
programs.  Perhaps  part  of  this  discrepancy  is  due  the  fact 
that  human  judgment  as  to  what  to  fix  and  when  can  be  a 
significant  part  of  the  reliability  growth  process.  More¬ 
over,  there  is  often  a  learning  process  on  the  part  of  the 
designers  as  the  test  results  unfold.  It  is  this  human 
intervention  in  the  process  that  motivated  the  approach  that 
is  taken  herein,  namely  a  learning  model  approach.  Stochastic 
learning  models  have  been  used  for  some  time,  and  one  recom¬ 
mended  by  Bush  and  Mosteller  [1]  has  shown  wide  applicability. 
A  reliability  growth  model  based  upon  this  method  has  some 
advantages  over  current  methods,  some  of  which  are  explored 
herein. 
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Stochastic  Learning  Model 

The  basic  model  under  consideration  applies  to  a 
sequence  of  experiments,  each  of  which  can  be  scored  a 
success  or  failure.  It  is  assumed  that  the  system  under 
consideration  is  only  altered  after  failures  occur.  There¬ 
fore,  the  probability  of  success  of  a  given  trial  depends 
only  on  the  number  of  failures  preceding  that  trial.  Let  P^ 
be  the  probability  of  success  after  k  failures  (and  fixes) 
have  occurred.  The  basic  model  is  given  by 

pk+i  ■  pk  +  c(1-pk>  (1> 

If  ir(k,n)  is  defined  to  be  the  probability  that  exactly 
k  failures  occur  in  n  trials,  then  the  expected  value  of 
P  after  n  trials,  which  is  the  reliability  R(n),  is 
given  by 

n 

R(n)  =  l  PkTr(k,n)  (2) 

o 

Now  for  any  given  value  of  C  and  the  initial  probability 

P  ,  the  values  of  P,  can  be  calculated.  Also,  ir(k,n) 

O  X 

can  be  calculated  using  the  relationship 

7r(k,n+l)  =  Pk7r(k,n)  +  (l-P^^)  it  (k-l,n)  (3) 

Finally,  R(n)  is  derived  from  TT(k,n)  and  P^.  Thus  the 
entire  process  of  generating  growth  curves  (R(n)  versus  n) 
requires  only  the  values  of  PQ  and  C. 

In  an  actual  development  program,  PQ  and  C  are 
generally  not  known  exactly.  However,  based  on  experience 
or  preliminary  analyses,  they  can  be  estimated.  This  suggests 
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a  Bayesian  approach  where  prior  probability  distributions  are 

generated  for  Pq  and  C  and  the  posterior  distributions  of 

these  parameters  are  computed  as  test  results  become  available. 

A  discrete  probability  distribution  will  be  used  to 

represent  the  prior  and  posterior  probabilities.  As  will  be 

seen,  it  will  be  convenient  to  introduce  a  joint  distribution 

for  P  and  C.  Let 
o 

NLj  =  Probability  (PQ  =  p^  and  C  =  c^)  (4) 

For  a  given  sequence  S  of  test  results,  the  posterior  dis¬ 
tribution 

mT .  =  P (P  =  p. ,  C  =  c . IS) 
o  *i'  3 

is  calculated  according  to 


Now  the  entire  process  of  growth  curve  generation  is  as  follows 

1.  Define  a  prior  distribution  for  Pq  and  C. 

2.  Using  test  results,  calculate  the  posterior 

distribution  for  P  and  C. 

o 

3.  Use  equations  1,  2,  3  to  determine 

Tr(k,n|PQ  =  p^,  C  =  c..)  and  R(n|PQ  =  p^  C  =  c^)  . 

4.  Take  the  expected  value  of  R(n)  over  the  pos¬ 
terior  distribution  which  is  the  expected  relia¬ 
bility. 

As  can  be  seen,  the  process  requires  only  an  initial  distri- 


bution  of  PQ  and  C  as  input.  The  process  is  readily 
programmed  on  a  digital  computer.  This  was  done  on  a  PDP  11-70 
for  the  purposes  of  this  study.  For  the  examples  chosen,  the 
required  calculations  were  accomplished  in  several  minutes, 
depending  upon  the  number  of  trials  and  the  number  of  points 
in  the  prior  distribution. 


Results 

Using  a  25  point  prior  distribution  (five  values  of 
Pq  and  five  values  of  C) ,  growth  curves  were  generated  for 
three  test  cases.  These  are  compared  with  those  generated  by 
the  AMSAA  model.  The  test  data  and  assumed  priors  are  given 
below.  Calculated  values  are  found  in  Appendix  B. 

SYSTEM  #1 

TOTAL  NO.  OF  TESTS:  279 

FAILURES  OCCURRED  AT  TESTS:  1,  3,  4,  5,  6,  7,  9,  11,  13,  14, 
19,  22,  24,  25,  26,  27,  28,  31,  36,  41,  44,  45,  47,  49,  53, 
66,  69,  70,  71,  73,  75,  76,  77,  87,  91,  92,  100,  102,  108, 
115,  116,  123,  124,  125,  129,  134,  135,  139,  143,  149,  151, 
152,  155,  156,  157,  161,  166,  173,  179,  181,  182,  185,  194, 
202,  207,  209,  229, 

The  prior  distribution  for  System  #1  is  given  as  follows: 
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NUMBER  OF  TESTS 


NUMBER 


In  each  of  these  cases,  the  AMSAA  model  has  a  steeper  initial 
rise  and  a  smaller  slope  thereafter.  This  type  of  behavior 
was  anticipated  and  is  one  of  the  reasons  for  seeking  other 
methods.  The  AMSAA  curve,  given  by 
1  -  \6TS_1 

will  have  an  infinite  slope  at  T  =  0  if  8  <  2  (which  is 
typical) .  Similarly,  if  growth  curves  are  calculated  on  the 
basis  of  a  small  number  of  trials,  the  AMSAA  model  can  yield 
results  which  are  without  meaning.  In  short,  the  curve  for 
small  values  of  T  is  of  little  value.  Alternatively,  the 
stochastic  model  uses  the  initial  reliability  of  a  design 
PQ  as  one  of  its  parameters.  This  should  yield  better 
results  for  a  small  number  of  trials.  Based  on  the  three 
cases  considered  here,  it  would  appear  that  the  stochastic 
model  gives  a  better  representation  of  the  reliability  in  the 
early  phase  of  development  and  yields  an  ultimate  value  of 
the  reliability  which  is  in  substantial  agreement  with  the 
AMSAA  method.  This  fact,  plus  the  additional  utility  of  the 
probability  of  program  success  capability  (to  be  discussed  in 
the  next  section)  are  sufficient  to  recommend  the  stochastic 
model.  The  additional  effort  required  is  small  once  the  com¬ 
puter  programs  are  written. 

Methodology 


The  examples  considered  were  already  completed  pro¬ 
grams.  The  number  of  tests  and  ultimate  reliability  were 
specified.  In  a  new  program,  these  would  be  undetermined. 
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Also  unknown  would  be  the  orior  distribution  for  P  and  C. 

o 

During  the  proposal  phase  of  a  system  development,  a  prelimi¬ 
nary  design  will  presumably  be  proposed.  Based  on  parts 
count,  failure  mode  analysis,  or  experience  with  like  designs, 
an  approximate  mean  value  P  of  Pq  is  chosen.  Now  let  N 
be  the  total  number  of  tests  in  the  planned  program,  and  P^ 
the  ultimate  reliability  to  be  achieved  by  the  end  of  the 
program. 


The  number  of  failures  (and  fixes)  required  to  reach 


the  desired  reliability  is 
,  1-P. 


k  = 


In  (1-C)  01 1-P 


u 


(6) 


and  the  expected  number  of  tests  to  produce  k  failures  is 


_  k;L  1 

"  =  (1-C)i(l-P0)  1 

These  two  equations  can  be  solved  simultaneously  to  find  k 
and  C . 


As  an  example,  consider  the  case  N  =  100,  P  =  .5, 


P^  =  .9.  From  Equation  6, 


1-P 


k  In  (1-C)  ln  (1-P  ] 


k  =  ~  In  .2  =  ^  In  5 


Equation  7  yields 


k-1 


100  =  2  l 


i=°  ^  in  5 


1 


1 


This  is  satisfied,  approximately,  by  k  =  20.  Thus 
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C  =  Jq  £u5  =  .08. 

At  this  point,  approximate  mean  values  have  been  calculated 
for  Pq  and  C.  It  remains  only  to  select  the  complete 
joint  distribution.  Uniform  or  triangular  distributions 
about  Pq  and  C  can  be  used  to  generate  the  priors  . 

The  sensitivity  of  the  model  does  not  appear  to  be  too  great 
so  long  as  the  mean  values  are  the  same.  So  the  process  of 
generating  priors  goes  quite  nicely  with  the  process  of 
initial  reliability  prediction  and  test  program  length. 

Since  most,  if  not  all  of  these  steps,  are  required  in  the 
original  proposal,  it  is  a  small  task  to  set  up  the  model 
originally  for  monitoring  progress. 


Probability  of  Success 


A  potentially  useful  product  of  the  analysis  des¬ 
cribed  herein  is  the  probability  of  reaching  a  specified 

ultimate  reliability  P  .  Denoted  by  P  ,  it  is  calcu- 

1  u  2  o 

lated  as  follows: 

P  (n)  =  l  tt  ( k ,  n  |  P  =  p .  ,  C  =  c.)M.  . 

Pk>Pu  01  3  13 

The  summation  is  carried  out  over  all  i,j,k  for  which 

P,  >  P  .  P  (n)  is  dependent  upon  n  and  the  test  results 

(through  M. .).  P  (n)  for  System  #2  is  plotted  in  the 
13  s 

next  graph  the  priors  and  test  results  are  as  before. 

Notice  that  estimated  probability  of  reaching  P^  =  . 9 
was  above  .7  initially.  After  failures  on  tests  3,4,5;  Pg 
had  dropped  to  .53.  There  are  two  possible  ways  that  such 
a  diagram  could  be  used: 

1.  As  a  trend  indicator  denoting  either  rapid  or 
gradual  changes  in  Pg . 

2.  In  the  manner  of  a  control  chart  with  lower 
limits  being  set  on  Pg  at  which  point  serious 
program  review  would  be  triggered. 


Sensitivity 

The  matter  of  the  sensitivity  of  the  results  to 
changes  in  the  priors  is  of  great  interest.  If  dramatic 
changes  in  predicted  reliability  occur  with  small  changes 
in  the  priors,  this  would  mean  that  resulting  growth  curves 
would  be  heavily  dependent  upon  the  input  distributions. 
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Since  these  are  judgmental,  high  sensitivity  would  call  the 
entire  method  into  question.  Naturally,  growth  curves  based 
on  a  few  tests  will  be  heavily  influenced  by  changes  in  M^j. 
This  is  illustrated  by  the  accompanying  curves  which  are 
growth  curves  based  on  one  test,  for  three  different  priors. 

The  base  case  is  the  same  as  was  used  previously  for  System 
#2.  Variation  #1  uses  a  distribution  which  weighs  higher 
values  of  Pq  more.  Variation  #2  weighs  higher  values  of 
C  more.  Figure  5  gives  the  curves  after  one  test.  Figure  6 
shows  the  resulting  curves  based  on  posteriors  after  109  tests. 
Behavior  typical  of  Bayesian  models  is  seen,  namely,  the 
results  are  less  dependent  on  priors  as  more  information  is 
included  in  the  posteriors. 

Sensitivity  of  a  second  type  is  also  of  interest. 

This  one  concerns  the  number  of  points  in  the  joint  distribu¬ 
tion  of  Pq  and  C.  Large  distributions  require  much  more 
computer  time  to  utilize,  while  small  distributions  may  reduce 
resolution.  Two  cases  are  shown  in  Figure  7,  a  25  point  and 
a  121  point  distribution.  The  two  are  both  discrete  approxi¬ 
mations  of  a  uniform  distribution  with  the  same  expected 
values.  As  can  be  seen,  there  is  very  little  difference 
between  the  two  curves.  Moreover,  the  25  point  case  runs  in 
one-fourth  the  computer  time. 

Certainly  the  number  of  cases  run  are  not  sufficient 
to  draw  general  conclusions,  but  the  sensitivity  of  the  model 
does  not  appear  to  be  too  great,  and  the  curves  based  on 


GROWTH  CURVE  SENSXTttVITY  AFTER  ONE  TEST; 


NUMBER  <t)F  TESTS 
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small  numbers  of  tests  are  surely  more  meaningful  than  Duane 
curves  based  on  similar  numbers  of  tests. 


Extension  to  MTBF 

The  model,  as  described  thus  far  is  designed  for  one- 
shot  items  which  either  succeed  or  fail.  It  is  not  applicable 
to  programs  where  the  system  in  question  is  tested  until 
failure,  the  time-to-fail  noted,  and  the  design  improved. 
However,  it  is  suggestive  of  a  model  which  is  applicable  to 
such  programs . 

Consider  a  repairable  system  whose  time-to-fail  is 
distributed  exponentially.  Let  A^  be  the  failure  rate  after 
i  failures  (and  fixes) .  Let  a  sequence  of  tests  (and  fixes) 
be  performed  on  the  system  with  being  the  time  of  the 

i-th  failure.  Also,  let 

Y.  =  X.  -  X.  .  . 

1  1  l-l 

Then  the  likelihood  function  for  a  sequence  of  N  failures  is 

-A  Y.  -A.Y.  -A„  ,Ym 

t  ,  .  ,  ,  o  1  12  N-l  N 

L  =  x0*x1,a2- • -An-1  S  ‘*’e 


N-l  N-l 

In  (L)  =  l  In  (A.)  -  l  A.Y.+1. 


If  some  relation  exists  between  successive  A^,  then  the 
problem  can  be  simplified.  A  useful  example  is 

A . . .  =  aA  . 

l+l  l 

which  implies 

A.  =  oxA  . 

1  o 
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If  x  >  1,  the  system  is  degrading.  If  a  <  1,  the  system 
is  improving.  It  follows  that 


N-l  . 


ln(L)  =  N  In  A  -  £  aX\  Y  +  — * bu 
o  .f-  o  i+l  2 


The  maximum  likelihood  estimates  of  X  and  a  are  found 

o 


from: 


«L  _  _  N  Nr1  i 

r~  °  ~  '  J  a  Yi+1 

O  O  1  =  0 


3£nL  _  ,  Nr^'  i-l„ 

— ~ =  o  =  - X  >  is  Y  .  . ,  + 

da  o . L  i+l 

1=0 


N(N-l)  1 
2  a 


Thus 


X  =  -rT- - 
o  N-l  . 


I  «XY, 


and  a  is  a  root  of  the  equation 
Ny1.N-l  i 

.i0(—  "  l)Cl  Yi  +  1  =  ° 

A  numerical  method  such  as  Newton-Rhapson  can  be  used  to  find 
a  in  the  latter  equation  which  can  then  be  used  to  solve  for 
A  .  This  method  has  been  applied  to  System  #2  test  data 
(using  all  109  test  results) .  The  resulting  maximum  likeli¬ 
hood  values  for  X  and  a  are 

o 

Aq  =  .428567 
a  =  .798853 


These  parameters  are  related  to  the  previous  model  as  follows: 


A  =  1  -  P0 
o  o 


and 


a  =  1  -  C. 

However,  MTBF  testing  is  often  for  a  specified  total  time  T, 
and  the  expected  MTBF  after  time  T  will  be 


l  iLpim  ■  1 


1=0  1 

where  P^(T)  is  the  probability  that  i  events  have  occurred 
by  time  T.  P^ (T)  is  obtained  from  the  solutions  to  the 
following  system  of  equations: 


dP 

=  -X  P 
dt  o  o 


.P.  +  ^ .  ,P.  , 

l  l  i-j.  i-u. 


Multiplying  by 


1  j 

- —  and  summing, 
Ai 


one  obtains 


§1 

dt 


-1 


+ 


1 

a 


Hence 


a-1 

a 


T 


Conclusions  and  Recommendations 

This  study  of  some  of  the  characteristics  of  the 
stochastic  learning  model  for  reliability  growth  prediction 
and  assessment  illustrates  several  characteristics  of  the 
model . 

1-  After  many  tests,  the  results  compare  favorably 
with  existing  methods. 


2.  For  early  assessment  (after  few  tests),  the 
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stochastic  model  is  more  applicable  than  existing 
methods . 

3.  Generating  the  priors  is  directly  related  to  the 
pre-program  planning  process. 

4.  Probability  of  success  monitoring  is  really  a 
way  of  periodically  reassessing  the  test  program. 

5.  The  model  does  not  appear  to  be  unusually  sensi¬ 
tive  to  priors  or  size  of  the  input  distributions. 

6.  The  model  has  a  natural  extension  to  repairable 
systems  and  mean  time  between  failure  calculation. 

7.  Programming  and  running  on  modern  high-speed  com¬ 
puters  is  easily  accomplished. 

These  features  appear  to  be  sufficient  to  recommend 
the  method.  However,  only  three  systems  have  been  evaluated, 
and  these  were  accomplished  after  the  fact.  Therefore,  it 
is  recommended  that  this  method  be  used  on  several  programs 
from  pre-planning  through  assessment  to  determine  its  utility. 
This  would  not  require  that  other  methods  be  abandoned  until 
or  unless  the  suggested  method  prove  more  useful.  At  that 
point,  a  decision  could  be  made  on  continuation  or  modification 

At  the  very  foundation  of  this  method  is  the  continuing 
assessment  of  whether  the  program  is  progressing  rapidly  enough 
to  meet  its  final  goal.  As  a  management  tool,  this  should  be 
invaluable.  Moreover,  the  model  is  based  on  behavioral  as¬ 
pects  as  well  as  the  complexity  of  the  system.  It  is  felt, 
though  not  yet  substantiated,  that  decisions  made  will  be 
more  accurately  modeled  by  the  method  described. 


APPENDIX  A 


Scope  of  Work 


1.  General 


This  Scope  of  Work  consists  of  engineering  effort  required  to  pursue 
the  evaluation/develooment  of  a  soecific  reliability  growth  model. 

The  particular  model  of  interest  is  a  3ayesian  learning  model  of  the 
fora  PR  +  ■  ?K  +  C  (1  -  ?£>  where: 

*  Probability  of  Xth  Event 

PR  +  ^  *  Probability  of  X  +  1st  Event 

C  -  Constant  Related  to  Learning  Rate 

2.  Objective 

In  reliability  growth  planning/projection  a  model  i3  needed  that  can 
be  used  to  accurately  predict  the  reliability  growth  of  one-shot  items 
such  as  missiles.  The  model  shall  have  the  capability  to  initially 
utilize  estimates  of  the  parameters  of  the  model  Oavesian  priora,  etc.) 
and  supplant  these  estimates  with  actual  test  data  as  it  is  generated. 
Existing  models  (Duane  and  others)  are  not  totally  satisfactory  for 
projecting  one-shot  item  reliability  growth,  especially  in  the  early 
phases  of  a  program  and  when  data  points  (item  test  data)  are  few  in 
number.  The  objective  of  this  effort  is  to  examine  in  detail  a  model 
of  the  type  specified  above  and  determine  if  it  can  be  used/aodif ied 
to  satisfy  this  need. 

3.  Specific  Tasks 


a.  Utilizing  actual  system  test  data  provided  by  the  MIRADCCM 
Product  Assurance  Directorate  on  3—4  recently  developed  missile 
systems,  determine  if  the  model  would  have  achieved  a  good  fit  of  the 
data.  Compare  the  fit  achieved  on  each  system  (with  the  model)  with 
the  AMSAA  Model  (Duane  Model)  fit  of  the  same  data. 

b.  Develop  complete  methodology  for  applying  the  model  to  relia¬ 
bility  growth  projections  for  systems  Just  entering  the  development 
cycle. 


c.  Examine  the  model  to  determine  its  relative  sensitivity  to 
estimates  of  the  model  parameters.  Determine  how  quickly  errors  in 
initial  estimates  of  the  parameters  of  the  model  are  reduced  by  pro¬ 
gressive  use  of  actual  data  as  it  is  generated. 

( 
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d.  After  accomplishment  of  tasks  a,  b,  and  c  above,  provide 
recommendations  on  appropriateness  of  the  model  for  use  by  MIRAOCOM 
for  reliability  growth  planning  including  any  changes/modifications 
deemed  appropriate  to  give  the  model  more  utility.  This  should 
include  consideration  of  modifying  the  model  so  that  it  can  be  used 
for  mean-time-between-failure  data  as  well  as  one-shot  data. 

4.  Reporting  Requirements 

a.  Oral  reports  as  requested. 

b.  A  final  report  (reproducible  master  plus  one  copy)  summarizing 
the  work  performed  and  conclusions  derived  under  each  task  shall  be 
submitted  to  the  COTR  within  30  days  after  completion  of  services. 


APPENDIX  B 


Growth  Curve  Data 


J 


SYSTEM  #1 
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Stochastic  Model 


Duane  Curve  ( 1- X  6N  1 ) 

S  =  .  643469  >.  =  1.78815 


Test  Test  Test  Test 

No.  Reliability  No .  Reliability  No.  Reliability  No.  Reliability 


5  .453871 

9  .477323 

13  .498814 

17  .518584 

21  .536837 

25  .553741 

29  .569444 

33  .58407 

37  .597728 

41  .610511 

45  .622501 

49  .633771 

53  .644383 

57  .654395 

61  .663855 

65  .672809 

69  .681297 

73  .689353 

77  .69701 

81  .704298 

85  .711242 

89  .717866 

93  .724192 

97  .73024 

101  .736027 

105  .741571 

109  .746886 

113  .751986 

117  .756884 

121  .761592 

125  .76612 

129  .770481 

133  .774683 

137  .778733 

141  .78264 

145  .786412 

149  .790055 

153  .793576 

157  .796981 

161  .800275 

165  .803464 

169  .806553 

173  .809546 

177  .812448 

181  .815263 

185  .817994 


189  .820646 

193  .823222 

197  .825725 

201  .828158 

205  .830524 

209  .832826 

213  .835066 

217  .837247 

221  .839371 

225  .84144 

229  .843457 

233  .845423 

237  .84734 

241  .84921 

245  .851035 

249  .852816 

253  .854555 

257  .856254 

261  .857913 

265  .859535 

269  .861119 

273  .862669 

277  .864184 

281  .865666 


5 

.351773 

9 

.474328 

13 

.53892 

17 

.580976 

21 

.611385 

25 

.634807 

29 

.653629 

33 

.669224 

37 

. 682445 

41 

.693857 

45 

.703851 

49 

.712708 

53 

.720634 

57 

.727788 

61 

.734291 

65 

.74024 

69 

.745713 

73 

.750771 

77 

.755466 

81 

. 759842 

85 

.763934 

89 

.767773 

93 

.771384 

97 

.774791 

101 

.778012 

105 

.781065 

109 

.783964 

113 

.786722 

117 

.789351 

121 

.791861 

125 

.79426 

129 

.796558 

133 

. 798761 

137 

.800876 

141 

.802908 

145 

.804864 

149 

.806748 

153 

.808565 

157 

.810318 

161 

.812012 

165 

.81365 

169 

815234 

173 

.816769 

177 

.818256 

181 

.819699 

185 

.821098 

189  .822457 

193  .823778 

197  .825062 

201  .826312 

205  .827528 

209  .828712 

213  .829866 

217  .83099 

221  .832087 

225  .833158 

229  .834203 

233  .835223 

237  .83622 

241  .837195 

245  .838147 

249  .839079 

253  .839991 

257  .840883 

261  .841757 

265  .842613 

269  .843451 

273  .844273 

277  .845078 

281  .845868 


SYSTEM  #2 
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Stochastic  Model 


Test 

No. 

Reliability 

Test 

No. 

Reliabil 

2 

.648134 

50 

.924783 

3 

.676819 

51 

.925932 

4 

.700693 

52 

.927046 

5 

.720944 

53 

.928125 

6 

.738385 

54 

.929172 

7 

.753594 

55 

.930188 

8 

.766993 

56 

.931174 

9 

.778903 

57 

.932132 

10 

.789569 

58 

.933063 

11 

.799185 

59 

.933968 

12 

.807904 

60 

.934848 

13 

.81585 

61 

.935705 

14 

.823127 

62 

.936539 

15 

.829817 

63 

.93735 

16 

.835992 

64 

.938141 

17 

.841711 

65 

.938911 

18 

.847023 

66 

.939662 

19 

.851973 

67 

.940394 

20 

.856596 

68 

.941109 

21 

.860926 

69 

.941806 

22 

.864989 

70 

.942486 

23 

.868811 

71 

.94315 

24 

.872413 

72 

.943798 

25 

.875814 

73 

.944432 

26 

.879031 

74 

.945051 

27 

.882078 

75 

.945656 

28 

.884969 

76 

.946247 

29 

.887716 

77 

.946826 

30 

.89033 

78 

.947391 

31 

.89282 

79 

.947945 

32 

.895195 

80 

.948487 

33 

.897463 

81 

.949017 

34 

.899631 

82 

.949537 

35 

.901707 

83 

.950045 

36 

.903695 

84 

.950543 

37 

.905601 

85 

.951032 

38 

.907431 

86 

.95151 

39 

.909189 

87 

.951979 

40 

.910879 

88 

.952439 

41 

.912505 

89 

.952889 

42 

.914071 

90 

.953331 

43 

.91558 

91 

.953765 

44 

.917035 

92 

.954191 

45 

.918439 

93 

.954608 

46 

.919795 

94 

.955018 

47 

.921105 

95 

.955421 

48 

.922372 

96 

.955816 

49 

.923597 

97 

.956204 

Duane  Curve  (1-A8N“ 


3  = 

Test 

No. 

=  .60512  X  = 

Test 

Reliability  No. 

.643436 

Reliability 

2 

.703874 

50 

.916927 

3 

.747686 

51 

.917575 

4 

.774781 

52 

.918204 

5 

.793777 

53 

.918817 

6 

.808102 

54 

.919414 

7 

.819435 

55 

.919996 

8 

.828709 

56 

.920563 

9 

.836493 

57 

.921116 

10 

.843156 

58 

.921656 

11 

.84895 

59 

.922183 

12 

.854051 

60 

.922698 

13 

.858592 

61 

.923201 

14 

.862671 

62 

.923692 

15 

.866361 

63 

.924173 

16 

.869724 

64 

.924643 

17 

.872806 

65 

.925103 

18 

.875645 

66 

.925553 

19 

.878271 

67 

.925994 

20 

.880712 

68 

.926426 

21 

.882988 

69 

.926849 

22 

.885118 

70 

.927263 

23 

.887117 

71 

.927669 

24 

.888998 

72 

.928068 

25 

.890773 

73 

.928459 

26 

.892452 

74 

.928842 

27 

.894043 

75 

.929218 

28 

.895554 

76 

.929587 

29 

.896991 

77 

.92995 

30 

.898361 

78 

.930306 

31 

.899668 

79 

.930656 

32 

.900918 

80 

.930999 

33 

.902115 

81 

.931337 

34 

.903262 

82 

.931669 

35 

.904363 

83 

.931995 

36 

.905421 

84 

.932316 

37 

.906439 

85 

.932631 

38 

.907419 

86 

.932942 

39 

.908364 

87 

.933247 

40 

.909275 

88 

.933548 

41 

.910156 

89 

.933844 

42 

.911007 

90 

.934135 

43 

.91183 

91 

.934422 

44 

.912626 

92 

.934704 

45 

.913398 

93 

.934982 

46 

.914147 

94 

.935256 

47 

.914873 

95 

.935526 

48 

.915577 

96 

.935792 

49 

.916262 

97 

.936054 

SYSTEM  #2  (Con't.) 


Stochastic  Model 


Test 

No. 

Reliability 

Test 

No. 

Reliabil 

98 

.956585 

104 

.958736 

99 

.956959 

105 

.959074 

100 

.957327 

106 

.959406 

101 

.957688 

107 

.959732 

102 

.958044 

108 

.960054 

103 

.958393 

109 

.96037 

Duane  Curve  (1-AgN^ 


£ 

Test 

No. 

=  .60512 

Reliability 

A  = 

Test 

No. 

.643436 

Reliability 

98 

.936313 

104 

.93779 

99 

.936568 

105 

.938025 

100 

.?16819 

106 

.938256 

101 

7067 

107 

.938485 

102 

■'  :  7311 

108 

.93871 

103 

7552 

109 

.938933 

j 


iC 


I 


27 


SYSTEM  #3 


Stochastic  Model 


Duane  Curve 

6  =  .501774  X  =  1.43041 


Test  Test  Test  Test 

No .  Reliability  No .  Reliability  No .  Reliability  No .  Reliability 


2 

.472249 

50 

.897904 

2 

.491855 

50 

.897789 

3 

.517579 

51 

.89956 

3 

.  584803 

51 

.898792 

4 

.55523 

52 

.901162 

4 

.640245 

52 

.899767 

5 

.58709 

53 

.902715 

5 

.678098 

53 

.900714 

6 

.614456 

54 

.904218 

6 

.70605 

54 

.901634 

7 

.638253 

55 

.905676 

7 

.727781 

55 

.902529 

8 

.659159 

56 

.90709 

8 

.745302 

56 

.9034 

9 

.677689 

57 

.908462 

9 

.759818 

57 

.904248 

10 

.694238 

58 

.909794 

10 

.772101 

58 

.905074 

11 

.709115 

59 

.911087 

11 

.78267 

59 

.90588 

12 

.722569 

60 

.912344 

12 

.79189 

60 

.906664 

13 

.734799 

61 

.913565 

13 

. 800026 

61 

.90743 

14 

.745969 

62 

.914753 

14 

.807275 

62 

.908177 

15 

.756213 

63 

.915909 

15 

.813787 

63 

.908906 

16 

.765644 

64 

.917033 

16 

.81968 

64 

.909618 

17 

.774358 

65 

.918128 

17 

.825045 

65 

.910313 

18 

. 782433 

66 

.919194 

18 

.829957 

66 

.910993 

19 

.78994 

67 

.920232 

19 

.834476 

67 

.911657 

20 

.796937 

68 

.921244 

20 

.838653 

68 

.912307 

21 

.803475 

69 

.922231 

21 

.842528 

69 

.912942 

22 

.809599 

70 

.923193 

22 

.846135 

70 

.913564 

23 

.815347 

71 

.924131 

23 

.849506 

71 

.914173 

24 

.820752 

72 

.925047 

24 

.852663 

72 

.914769 

25 

.825846 

73 

.925941 

25 

.855629 

73 

.915353 

26 

. 830655 

74 

.926814 

26 

.858423 

74 

.915925 

27 

.835202 

75 

.927666 

27 

.86106 

75 

.916485 

28 

. 839508 

76 

.928498 

28 

.863555 

76 

.917034 

29 

.843592 

77 

.929312 

29 

.86592 

77 

.917573 

30 

.847472 

78 

.930107 

30 

.868166 

78 

.918101 

31 

.851161 

79 

.930885 

31 

.870302 

79 

.918619 

32 

.854675 

80 

.931645 

32 

.872337 

80 

.919128 

33 

.858024 

81 

.932389 

33 

.87428 

81 

.919627 

34 

.861222 

82 

.933117 

34 

.876136 

82 

.920117 

35 

.864277 

83 

.933829 

35 

.877912 

83 

.920598 

36 

.867199 

84 

.934526 

36 

.879613 

84 

.92107 

37 

.869997 

85 

.935208 

37 

.881246 

85 

.921534 

38 

.872679 

86 

.935877 

38 

.882813 

86 

.92199 

39 

.875252 

87 

.936531 

39 

.88432 

87 

.922438 

40 

.877721 

88 

.937173 

40 

.88577 

88 

.922878 

41 

.880094 

89 

.937801 

41 

.887167 

89 

.923311 

42 

.882376 

90 

.938418 

42 

.888513 

90 

.923737 

43 

.884573 

91 

.939022 

43 

.889813 

91 

.924156 

44 

.886688 

92 

.939614 

44 

.891067 

92 

.924567 

45 

.888726 

93 

.940195 

45 

.89228 

93 

.924973 

46 

.890692 

94 

.940764 

46 

.893453 

94 

.925371 

47 

.89259 

95 

.941323 

47 

.894589 

95 

.925764 

48 

.894422 

96 

.941872 

48 

.895689 

96 

.92615 

49 

.896192 

97 

.94241 

49 

.896755 

97 

.92653 
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SYSTEM  #3  (Con't.) 


Stochastic  Model 

Test  Test 

No .  Reliability  No .  Reliability 


98 

.942938 

111 

.949017 

99 

.943457 

112 

.949432 

100 

.943966 

113 

.949839 

101 

.944467 

114 

.95024 

102 

.944958 

115 

.950635 

103 

.945441 

116 

.951024 

104 

.945915 

117 

.951406 

105 

.946381 

118 

.951783 

106 

.946839 

119 

.952153 

107 

.94729 

120 

.952518 

108 

.947733 

121 

.952878 

109 

.948168 

122 

.953232 

110 

.948596 

123 

.953581 

Duane  Curve 

S  =  .501774  >.  =  1.43041 


Test 

No. 

Reliability 

Test 

No. 

Reliability 

98 

.926905 

Ill 

.931303 

99 

.927274 

112 

.93161 

100 

.927637 

113 

.931912 

101 

.927995 

114 

.93221 

102 

.928347 

115 

.932504 

103 

.928695 

116 

.932795 

104 

.929037 

117 

.933082 

105 

.929375 

118 

.933365 

106 

.929708 

119 

.933644 

107 

.930036 

120 

.933921 

108 

.930359 

121 

.934193 

109 

.930678 

122 

.934462 

110 

.930993 

123 

.934728 

APPENDIX  C 


Priors  For  Sensitivity  Analyses 

Base  Case 

As  given  for  Systems  #2  and  #3  on  page  5 
Hiaher  Growth  (c) 


.2 


Hiaher  P 


C 


6 

.02 

.03 

.04 

.05 

VD 

O 

2 

.02 

.03 

.04 

.05 

.06 

8 

.02 

.03 

.04 

.05 

.06 

4 

.02 

.03 

.04 

.05 

.06 

■J  s  + 
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